Co-design of deep neural nets and neural net accelerators for embedded vision applications
نویسندگان
چکیده
منابع مشابه
A Taxonomy of Deep Convolutional Neural Nets for Computer Vision
Traditional architectures for solving computer vision problems and the degree of success they enjoyed have been heavily reliant on hand-crafted features. However, of late, deep learning techniques have offered a compelling alternative – that of automatically learning problem-specific features. With this new paradigm, every problem in computer vision is now being re-examined from a deep learning...
متن کاملDeep Convolutional Neural Nets
The activation can be rewritten as follows a = vx+ b where v = [w1, . . . , wD] and b = wD+1 , and is an inner product between a weight vector v and the input x plus a bias b. For different inputs x of the same magnitude1, the activation is maximum when x is parallel to v, and the latter can be viewed as a pattern or template to which x is compared. The bias b then raises or lowers the activati...
متن کاملRegularization for Unsupervised Deep Neural Nets
Unsupervised neural networks, such as restricted Boltzmann machines (RBMs) and deep belief networks (DBNs), are powerful tools for feature selection and pattern recognition tasks. We demonstrate that overfitting occurs in such models just as in deep feedforward neural networks, and discuss possible regularization methods to reduce overfitting. We also propose a “partial” approach to improve the...
متن کاملDesign of Hardware Accelerators for Embedded Multimedia Applications
The subject of this work is the design and the implementation of hardware components which can accelerate the computation in a microprocessor-based digital system controlled by a RISC (Reduced Instruction Set Computer) core. Indeed a RISC core alone cannot achieve the desired computational capability needed to meet the requirements of modern applications, especially demanding ones like audio/vi...
متن کاملKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge transfer is widely held to be a primary mechanism that enables humans to quickly learn new complex concepts when given only small training sets. In this paper, we apply knowledge transfer to deep convolutional neural nets, which we argue are particularly well suited for knowledge transfer. Our initial results demonstrate that components of a trained deep convolutional neural net can c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IBM Journal of Research and Development
سال: 2019
ISSN: 0018-8646,0018-8646
DOI: 10.1147/jrd.2019.2942284